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ABSTRACT 

Culminating a 6-sonth assessment effort by Control 
Data Corporation's (CDC) Engineering Management Operations (EHO) , the 
report was prepared to help meet the Department of Agriculture's need 
for an assessment of (1) rural health care services research as a 
whole and (2) the knowledge contained in that research. The CDC 
"Final Report** vas presented in a large volume in order to make the 
entire data base available for different policy uses, assessment 
methodological applications, and further discussions. Prepared by EHO 
after th%. completion of the Final Report, this executive summary 
further explains the presumptions, assumptions, methodologies, 
conclusions, and recommendations of that report. Policy-relevant 
findings of the assessment are summarized and clarified by: (1) 
presenting the models and objectives (values) used in the systems 
approach which produced the Final Report's recommendations; and (2) 
demonstrating a potential systems approach to the utilization of the 
Final Report's data base elements toward the goal of achieving a 
comprehensive knowledge assessment. The accepted research 
publications are categorized by: (1) indepth subject category and (2) 
document access number. (HQ) 
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Introduction 

• 

The Assassment of Rural Health Research-! Final Report s -CEinal 
ReDort> culiminated a modest six month assessment effort by 
Control Data Corporation's -CCDC's> Engineering Management 
Operations -CEf10> for the United States Department of Agriculture'; 
Office of Planning & Evaluation -COPE} to help meet the Depart- 
ment's n9ed for an assessment of rural health care services 
research as a whole and an assessment of the knowledge contained 
in that rrsearch- This need was mandated by Sections lOMi llfi 
and b03 of the Rural Development Act of 117Sn which respectively : 

o Authorized loans to rural communities for development 
of essential community facilities -Cincluding health 
facilities}* 

o Authorized loans to private entrepreneurs for the 
establishment of business or industrial enterprises 
{including health facilities}* 

o Authorized and directed the Secretary of Agriculture 
to coordinate the various Federal rural development 
^ programs {including rural development research of which 

rural health is a component}* 

Section b03 requirements were delegated to the Under Secretary 
of Rural Development and portions further delegated to the 
Rural Development Service CRDS}* 

The CDC Final Report was presented in a large volume in order 
to make the entire data base available for different policy usesi 
different assessment methodological applications and further 
discussions* The Final Report will be available shortly through 
the NTIS and possibly the ERIC technical information systems* 
This Executive Summary was prepared by EMO after the completion 
of the Final Report * It was prompted by the perceived need to 
further explain the presumptions^ assumptions-! methodologies-! 
conclusions and recommendations of that Final Report * It will 
summarize and clarify policy-relevant findings of the assessment 
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Presenting the models and objectives lvalues} used in 
the systems approach which produced the recommendations 
of the Final Report {Section 

Demonstrating a potential systems approach to the 
utilization of the data base elements of the Final Report 
toward the goal of achieving a comprehensive knowledge 
assessment* Such an effort ideally would be institution- 
alized* 



The Systems ^'' nroach to Rasearch 

TI-.^ systems approach to i*3search is referred to hereafter 
as •'terticiry research*" •'Tertiary research** denotes the 
monitoring-i collecting-i classifying and aggregating of basic 
and applied research documents as well as development documents* « 
In systems terminology-i this tertiary research woiJld be synonymous 
to a formalized feedback network controlled by defiji^tive policy 
goals and/or knowledge neeids* This approach should ideally be 
used in administering and planning any sizeable research and 
development program by the administrative body in control of 
the allocation of research funds* 

Conceptually this "tertiary research" is integrated into a 

**social action" policy planning processi impacting the three 

levels of creative policy planning as described by Erich Jantsch ~ 

the normative -Cthe "ought">-i strategic -Cthe "can**! and the 

operational -Cthe "will">*«« In assessing the rural health care 

research programs-i the following research and development model 

was used as a standard J ^^^4.^^^,, 

Tertiary 

Research^ 

Activity 

AC 



Basic . 

Research 

Activity 




data 



II 11 



• Applied 
Research 
Activity 




data 



Development 
Activities 



» This assessment study would be classified as tertiary research-i 
but of a preliminary nature* This will be discussed further 
later* 

** •'Social Action" concept as described in the Final Report pages 
3-H and S-1 corresponds roughly to Erich Jantsch* s "rational' 
creative action" -["From Forecasting a Planning to Policy 
Sciences"-! Policy Sciences 1 {n70>-i 31-M?*> 
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Specifically the ideal "tertiary research" activity is 
COBposed of the following: 

o a "normative" policy expressing the "oughts" or 
specific values which reflect directly on the 
problensi here the rural health problems. This 
would include "normative" statements on the desired 
quality of rural health and possible rural health 
services models to attain such a leveli 

o a technical information system-i which collectis« 
classifies and aggregates research and development 
documents producing policy inputs and receiving 
policy feedback-! 

o a nanagement Information Systen-i which collects 
research administration data on ongoing and past 
research and development activities* 

NASA's research and development program is an example of 
such a "tertiary research" program. In NASm»s tertiary research 
mechanism its Scientific and Technical Information Facility 
performs the function of a Technical Information system* This 
"tertiary research" concept is described further in the final 
section of this summary. 

Liwitations Affecting Design 8 Data of Stifdv 

The assessment "system" was limited and thus its design and 
data affected by the following factors: 

o limited assessment resource funding by USSA* 
o limited time. 

o fragmentation/scattering of rural health research {final 
reports and publications! among countless periodicals-! 
technical information'^ systems-i and the strong prospect 
that- a majority of research is not disseminated in 
periodicals or technical information systems. 

o lack of a structured USDA -Cor 1>HEU> rural health "normative" 
policy and thus specific rural health policy needs and 
non needs* 

0 a vacuum of research methodologies heretofore for a 
"knowledge assessment" of rural health research* 

To deal with the first three limitations <resources-i time 
and fragmentation/scattering of the research! several trade-offs 
were jointly planned and approved by EMOi OPE and several know- 
ledgeable individuals in other USDA agencies. These trade-cffs 
are presented in the Final Report and the reader is referred to 
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Section 2-, page 2-3 to 2-12 of that report. Summarily they 
were: limiting the search to documents which were available 
in the District of Columbia area-information systems and 
limiting the research site to within the United States and its 
territories-! and limiting the documents* publishing date to 
post-December 31i nb«|. Originally onlv publications from 
completed research or completed significant substages of research 
were to be surveyed* However during the assessment effort it 
was decided by CDC and OPE to include a limited assessment of 
ongoing research to provide a more complete view of the rural 
health care situation- 
Regarding the fourth limitation -Clack of structured USDA 
rural health policy and thus specific policy knoitledge needs>-i 
Eno conduct £d a two part task to fill this void. This further 
defined and refined the objectives of the study and indicated 
tentative policy knowledge needs -Csee Section 2-i pages 2-1 to 



The first part of this task was an informal interviewing of 
several key public seccor -<USDA s DHEU> and private sector 
people related to or responsible for rural health care service-Cs>- 
The consensus of this informal interviewing was that the assess- 
ment effort would be useful if its 

o Inventoried {listed> research of rural health care 
services-! 

o Identified problem-oriented research of depth and 
quality for use to decision-makers-* i.e.-! research 
in which alternative courses of action are compared 
in terms of desired outcomes-! subject to the constraints 
of resources and value preferences-! 

o Evaluated this problem-oriented research as to quality. 

Thi-^ informal interviewing also brought forward two hypotheses 
to be discussed later. 

The second part of this task was a review of pending 
Congressional legislation relevant to rural health administrative 
actions and relevant to rural health agency actions. Three 
general national, health goals were derived; they are improve- 
ment of access-! assurance of quality and containment of costs. 
The results of this two-part effort were used to mitigate the 
limiting effects of unstructured USDA rural health policy and 
thus define the knowledge needs that may be of use when USDA 
does formulate such a structured rural health policy. 

The last limitation deserves more explanation. In the 
history of health services research-! no convention of tools-! 
characteristics and procedures has been formulated to be used 
in a so-called "knowledge assessment" of health care services 
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or the subcomponent rural health care services* Health Services 
Research and RaP in Perspective edited by E*E* Flock and 
p. J. Zanazaro cites this problem and presents the precurser? 
of such a convention* Any •'ideal'' knowledge assessment would 
involve aggregating the data elements in the research documents 
identified and comparing these aggregated data elements with 
models of the "ideal" rural health care services delivery system 
components* Such an "ideal" knowledge assessment is beyond the 
current "state of the art" of rural health care services method- 
ologies because of a lack of health services research aggregating 
methodologies* 

Consequently the fifth limitation Ca vacuum of "knowledge 
assessment" rural health services methodologies>-was handled 
by surveying what methodologies existed and formulating a 
knowledge assessment aggregating framework from data elements 
of relevant papers- These papers were identified through an 
independent literature search without publishing date limitations 
i*e*-i pre-n70 papers were included*4c This knowledge assessment 
framework and a demonstration of its utilization will be pre- 
sented later in this summary by applying a model of an "ideal" 
rural health carp services delivery system* 

These five limitations led to recommendations 1^ H and b 
presented in Final Reoorti Section 12- 

Recommendation 1 > "The creation of a comprehensive rural 
health policy with a supporting-i i-e-i complementary rural 
health care management information system and evaluation 
techniques*" More specifically this system would be both a 
management information system and a technical information system* 

Recommendation M > "The need for applied research into a 
method of aggregating the results of rural health care services 
research into a structured scientific model of the existing 
rural health care services system"* 

Recommendation b> "The need to explain to researchers the 
importance. of disseminating their research publications ^and 
especially final reports! to the national information systems 
or to a rural health care services management information 
system-i i*e*-i increase the 'social action' consciousness of 
rural health care services researchers." 

These recommendations as well as others will be reinforced 
later in this summary* 

J>efinitions 

This assessment study concentrated on "problem-oriented" 
research* To do this two series of classifications were 



> See attacheo bibliography of these papers* 
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ro^oIl!^hf!""^ series, outcome type, is based on the specific 
ceptions of "research" with those of "develoomen?" ?n\£2 

and development with research and^evero"?m1nS'^'f?5rt"ln%%7rr'' 

Siluallv 2iinr?hi^lKK"""f?^' "^^^ transformation is done 
visually using the abbreviations presented above- 

R«1>/F1> Basic Research 

Sfl/R Applied Research 



RSI>/R development 



p.ti/J* should be noted that documents classified as SM/O ^nH 
for miscellaneous b"i in^eies^Sn'g^ollenls"'"' 

to meet immediate objectives/but is uiLiL^ 
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can lead to improvements in social conditions*** 



Applied Research -CSM/PA-i SI1/R> **is concerned with funding the 
means for meeting a recognized need^ It draws upon the general 
principles established by basic research investigations and in 
turn creates additional knowledge- It differs from basic research 
in that it is oriented toward practical applications rather than 
toward investigation for its own sake- In the course of applied 
research activity the first pilot steps may be taken to reduce 
an abstract idea to a useful purpose-i frequently as a forerunner 
to development •*'*3)c 

Development -CRSD/PAi RSD/R> ''is the systematic use of knowledge 
and understanding gained from rese&'^ch and directed to the 
production of useful materials^ devi .asi systems and methods^ 
such work includes the desigm testing and improvement of proto- 
types and processes- Oevelopment is directed to generally 
predictable and very specific endsi and because such work results 
so often in tangible products-! it can be readily associated with 
distinct national goals-^^^^c In the case of rural health care 
services research and development such national goals might be 
equality of accessi assurance of quality and containment of costs- 

Assessment of Rural Health Care Research - Overview Findings 

Only federally funded activity will be addressed here because 
of its pragmatic policy relevancy- Of 3S1 documents {periodical 
articles and final reports} which met all screening criteria^ 

are "other" outcome types leaving EIH which are strictly 
research and development documents- Note the funding source 
distribution of these documents- 
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♦Federal Funds for Research-i Development and Other Activities -! 
Volume XVIIIi NSFi Uashingtom D.C.-i ntTi page IQ. 
»*Ibidi page m 
***Ibidi page n 
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The federal government-! basically DHEUi US»A and OEOi dominates 
"basic and applied research" and-s as expectedi especially dominates 
"development". Overall m3 or SS'BZ of the strictly research and 
development documents are federally funded wholly or partially* 
This domination is reinforced by observing that "Regional Govern- 
aent" includes Regional Medical Programs -CRIIPli Comprehensive 
Health Planning -CCHPJ and other federally supported planning and 
implementation groups* 

The basici applied and development distribution of federally 
funded research and development is as follows: 

No* Z 

]>evelopment HS 31*5 

Applied m 32* a 

Basic 51 35*7 



1>I3 100 



The geographic scope of this federally funded activity-i that 
is the site to wf-ich it was addressed-i is c.s follows: 



Geographic Scope 


Basic 


Research 


Applied 


Research 


Development 




No* 


'/. 


No* 


_z 


No* y. 


National 




17*7 


13 


27*6 


6 17*6 


Regional 


7 


13*7 


b 


12*6 


3 b*7 


State 


H 


fi.O 


12 


25* M 


T 20*0 


Local 


31 


tO*b 


lb 


3M*0 


25 55*5 




51 


100 


H7 


100 


M5 100 



As mentioned previously-! the informal interviewing activities 
set forth two hypotheses* The hypotheses ares 



1> Basic research substantiating deficiencies in rural 
health care services research is abundant* 

2> Applied research into the operating relationships of 
the rural health care services "system" and about 
alternative operating improvements for decision making 
is lacking* Thus design-t testing and improvement of 
prototypes and processes {"development" in the present 
terminology} would be included in this category* 

The assessment effort experience substantiates these hypotheses* 

For example-i consider that the Cooperative State Research 
Service -CCSRSJ is representative of USDA rural health care 
services research funding authority and the Health Services and 
Mental Health Administration -CHSMHA} is representative of DHEIi) 
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rural health care services research funding authority. Then the 
total and social sciences subtotal budgetary obligations for 
fiscal l<i70 {"social sciences" because cf its disciplinarian 
domination of rural health care services research! in thousands 
of doll&rs IS as follows: 



CSRS 
HSriHA 



Basic Research* 
total social 
sciences 



43ibl5 



5i2bl 
7il03 



Applied Research** 
total social 
sciences 



36ibQ7 
ISBiBbl 



13^005 



]>evelopfflent*** 
total social 
sciences 



-Cnone designated! 
TiS3M -Cnot broken 
out> 



This pattern of basic research-! applied research and development 
relative funding proportions follows the federal obligated 
budgetary allocation omitting NASAi the Atomic Energy Commission 
•CAEO and the Department of Defense -CDODJ for fiscal 1170 ."egard- 
less of subject area- These totals are shown below in millions 
of dollars: 





Basic Research 
total 


Applied Research 
total 


Development 
total 


federal Government **** 
{omitting NASAi AEC & DOD> 


1M7 


Ii3b5 


Ml 3 



des 
in 



T**®,™^ applieo-research-to-basic-research funding proportion 
in 1170 of l.t «,SfiM/S,2tl> is not reflected in the assessment 
findingsi assuming a direct correspondence between budgetary 
allocation levels and number of projects. 

Clearly this fact can be explained through the assessment's 
ign trade-off of inventorying only District of Columbia area 
formation systems and not inventorying research not in these 
systems. However it is EflO's opinion that rural health services 
research and development not controlled by a "tertiary research" 
activity, i.e. not systematically reclaimed from the hinterland 
of field research and properly aggregated, is in reality research 
undirected toward solving any practical rural health problems. 
Research and development programs should be directed toward 
purposes beyond the training of graduate students and remuneration 

*If^^^ 5"^^'' ^"^ ''ederal Funri,*; f or Research, Development anri 

Other Scientific A ctivities , Volume xvttt, f.!achi»qt"ni d C i " 

National Science Foundation, llbl 
**Ibid, Table C-SO and C-bt 
***Ibid, Table C-bl 
****Ibid, pages 10 through m 
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of researchsrs and their institutions. Thus the failure to "find" 
such research and development in no way undermines this position 
— it reinforces the ''tertiary research" conceptual need. 

The transformation from assessment research type/outcome type 
to conventional research and development definitions could also 
be used as an explanation for the lack of correlation between 
the CSRS applied-research-to-basic-research funding proportion 
and the assessment findings. However from a pragmatic point of 
viewi the definition transformations are practical and reflect 
actual evaluation of the research as well as its intended basici 
applied or development purpose. 

The applied-research-to-development-activity "budgetary 
proportion in fiscal n70 is interesting. The HSOHA pattern 
follows closely that of the federal government, omitting NASAi 
AEC and DOI). However CSRS has no designated development 
budgetary obligations. Nevertheless the assessment findings 
do reflect a substantial but lower applied-to-development 
proportion-! possibly a result of "social action" consciousness 
on the researcher's part or bias from the assessment classifi- 
cation/evaluation -Cresearch type/outcome type> terminology. 

Contrasting the above research and development funding 
proportions 1 the pattern which emerges when total federal 
obligated budgetary allocations including NASAi AEC and DOD 
are considered is critically different. The fiscal IIIQ figures 
in millions of dollars are as followss 





Basic Research 
total 


Applied Research 
total 


Development 
total 


Federal Government* 
{including NASAn 
ACC and D01» 




3-1713 


10 n 37b 



Obviously the NASAi AEC and SOD group has heavy technology- 
intensivei Jiardware-dependent development programs- There may 
also be correlation between this pattern and the well defined 
policy objectives and Congressionally backed policy priorities of 
these thre^ agencies. Furthermore all three agencies have highly 
developed "tertiary research" activities to best allocate their 
research funding resources among those knowledge need areas 
related to their distinct policy objectives. 

Without considering the quality or depth of knowledge of the 
rural health care services researchi in light of the profound 
health inadequacies of specific rural areas -Csee the Final Report , 
Section T and its Appendix 1-2 for statistical examples of these 
inadequacies}, the assessment effort results and the above inter- 
pretations tend to support the two hypotheses offered above. In 
essence the present basici applied and dovelopmental mix is 
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inadequate to come to grips with the deficiencies of rural health 
care services delivery systems- Based on extensive searching*! 
it is doubtful that USDA and DHEU {the two major federal rural 
health research and development sources - OEO is now under DHEU> 
possess ••tertiary research** activities systematically directed 
by structured rural development policy objectives* Based on the 
uncoordinated research exposed in Section 7 of the Final Report -i 
it is even more doubtful that they coordinate these •'tertiary 
research** activities- This direction and coordination would be 
listed under •'intramural*' development activities in the Federa 1 
Funds for Research -i Development and Other Scientific Activities -! 
Volume XVIII - die do find that two thirds of HSHHA development 
budgatary obligations are intramural but we could find no 
examples of such ccmprehensi\e rv^ral health ••tertiary research^** 
As shownn CSRS has no development budgetary obligations listed- 
CSRS's CRIS is a management information systems net a technical 
information system as would be required by a ••tertiary research** 
program- The National Agricultural Library's CAIN system is a 
technical information system but is not comprehensive enough for 
rural health- These two sryst^ms uill be discussed further- Tha 
other information systems surveyed -CNTIS-i ERICn SIEn NLM-i etc- — 
see Final ReDor t'> page 2-10 to S-ll> do not meet the ••tertiary 
research^* requirements for a technical information isystem for 
rural health- 

This **tertiary research** inadequacy or nonexistence is viewed 
fro« a different perspective in Table 1-! Research Performers with 
Federal Funding - Assessment Stat, tics- Note the paucity of 
US]>A and DHEU performed {intramural> development activity- A 
siailar dearth exists with the ••Health Planning Agencies^^ and 
would be explained by the funding weaknesses of CHP's and to 
a lesser degree RMP^s- Also note the dominance of colleges and 
universities in all three classifications of research and develop- 
ment activities- This is borna out in Table 2 which shows fiscal 
I'lTO budget obligation figures in thousands of dollars- {The 
Agricultural Research Service^ ARS-! is shown because it is USDA's 
largest research and development component- > 

Ue would like to refer back to the ••geographic scope^* 
distribution presented earlier in this section* ••Locally^^ focused 
research*! that is subcountyi county or multi-county within a 
specific states dominates basicn applied and development activities- 
The pervasiveness of rural health care delivery problems are of 
such a nature that this local focusing of research is appropriate- 
The basis of the Knowledge Assessments Section 7 of the Final 
Rep ort -! is a high resolution spectrum of rurality linked to the 
county as a geographical unit- However such ••local^^ oriented 
research will not deliver its maximum potential unless this 
research is aggregated through the ••tertiary research^^ concept 
presented in this summary- Thus any plans for increased areawide 
research {••Regional^^ and ••National^^> should be a systematically 
derived mixture of such areawide studies and formalized ••tertiary 
research^^ activity concentrating in part on the aggregation of 
this loc^l research- 



Table 1 - Research Performers with Federal Funding * Assessment 
Statistics 
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From this data the following hypothesis is formulated^ 
"tartiary research" activity or an analogous activity is conducted 
by the Agricultural Research Service and the Cooperative State 
Research Service in their agricultural development efforts as 
well as by other USDA agencies involved in agricultural develop- 
ment- Consequently the CSRS has a management information system 
with high agricultural development resolution -CCRISJ- The 
National Agricultural Library's CAIN system is the counterpart 
technical information system with high agricultural development 
resolution. Rural development resolution including rural health 
services research is relatively lower and warrants serious 
discussion and action* 

In summary these considerations and interpretations form the 
basis for recommendations No- Ht3tS-i7 and T presented in the 
Pinal Report i section 12- 

Recommendation gi "The need for a single agency to be active at 
the Federal level with the responsibility for synthesizing 
systematic planning for a national rural health care system*" 

The implementation here of course is flexible. Yet the 
coordination responsibilities delegated to the Rural Development 
Service -CRDS> [Rural Development Act of n7S section toa] could 
be ideally realized here- If the RDS were given the tools to 
conduct rural health "tertiary research" regardless of the funding 
sourcei e.g. DHEU or HUDi then it would be in the prime position 
to coordinate all federally funded rural health care services and 
furnish authoritative rural health policy components as inputs into 
HEM'S National Council on Health Planning and Development {NCHPD>. 
The NCHPD has been mandated by National Health Planning and 
Resources Act of im -CPL 13-tm> as the mechanism to conduct 
"development" activities in the nation's health care services 
"system". Recommendations It 3 and H are reinforced by this 
recommendation. Implementation of this recommendation by RDS 
-Cor another USDA component! would require close RDS/NCHPD 
cooperation. 

Recommendation 3 i "The continuation of the data base resulting 
from this assessment effort by not only continuing to inventory! 
classifyi and evaluate-i but to enlarge its capt^ure techniques and 
subject ar^as* The purpose would not only involve the effective 
dissemination of rural health care services research to researchers 
and decision-makersi but the coordination of rural health care 
services research in-house and out-of-house. Thusi one major 
rural health care services research data base would stimulate a 
systematic approach to the problems of rural health." 

This addresses the stated need for a technical information 
system as the heart of a "tertiary research" activity linked to 
a management information system* 

Recomme ndation 5 -i "flore constructive dialogue between rese.irchers 
<academicians> and the policy-makers to lessen the 'conflict* 
between their respective theoretical and practical orientationsi 

^ 0015 



hopefully leading to more problem-oriented research by more 
•social action* oriented researchers and more management oriented 
policy-makers who systematically know what objectives they want-" 

This will be of prime importance to any successful implemen- 
tation of a "tertiary research" activity-i i-e- Recommendations 
2i3iHi and b- It will also be a necessity for the attainment of 
Recommendation 7 below* 

Recommendation 7t "The need to increase the amount of "problem- 
oriented research" recognizing the need for other types of research- 
Rural health problems require such problem-oriented research if 
solutions are to be found-" 

This means an increase in applied research and development 
activities- However historically such emphasis on development 
activities only accompanies political mandates and should be 
accompanied by "tertiary research" activities controlled by a 
concrete systems approach effected policy direction {involving 
normative-! strategic and operational policy levels>- 

Recommendation 1-. "The investigation by USDA into the national 
health services data system being constructed by DHEU's Center 
for Health Statistics-" ye would anticipate that any national 
health care services delivery system-i whose planning and imple- 
mentation has been mandated by PL IB-tlli would utilize very 
heavily this "national health services data system" to zero in 
on geographical problem areas and health needs of those problem 
^reas' Likewise the implementation of Recommendation 2 with \ 
RJ>S or any other USDA component would require closer RDS/NCHPD 
cooperation- The Center for Health Statistics would be a logical 
point to increase this cooperation and ensure that rural areas 
are included "properly" -Cproper rural resolution} in this "national 
health services data system"- (Jhe Office of Rural Health's 
%1>HEU> impact on increasing this "rural resolution" has not been 
observed as of this time3- 

Pemcnstration of a Use of The Assessment's, Data Base Elements 

As stated above-i the systems approach to rural health care 
services research -Cand development activities! used in the 
assessment effort is based on the following: 

o To systematically control the direction and thus attain 
the practical social objectives of any large research 
and development program-i "tertiary research" activity 
must be implemented- 

o "Tertiary research" activity necessarily involves know- 
ledge assessments on an almost continual basis- "Ideal" 
knowledge assessments involve "aggregating the data 
Clements in the research documents identified and comparing 
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these aggregated data elements with models of the 
'ideal* rural health care services delivery system 
components •** 



' This "aggregating" task ensures the input of normative policy 
elements-! personified through the choice of "ought to" models-i 
into the "tertiary research" activity. Thus the "tertiary research" 
activity is brought out of an environment isolated from decision- 
makers and is connected through feedback mechanisms to policy 
formulation and to the decision-makers* This will be seen more 
easily by a closer look at this "ideal" knowledge assessment 
methodology. A visual step-by-step conception of it is presented 
in Figure 1« 

The assessment effort embodied in the Final Report approximates-! 
within the limitations discussed earlier-! steps l-!2-!3 and part of 
step »*. The "geographic aggregation" of step 3 shows potentially 
large knowledge vacuums in a "rurality definition spectrum" taking 
into account experimentally isolated variables <see "Bibliography"] 
of "economy of scale" and -"access distance" -Csee Section 7-! Final 
Report>. This is the basis for the Final Report's Recommendation fl. 

Recommendation fi -> "The adoption of more dynamic concepts of 
•rural*-! e.g. the concepts behind the indepth assessment to include 
the dimensions of economies of scale and access distances of ERS*s 
non-commuter/commuter counties concept". Since step H is only 
partially complete the demonstration will proceed from there. 

First "policy determined models of the Department's rural 
health care services involvement and goals" would have to be 
identified. For the purpose of the demonstration-! relevant policy 
elements will be assumed as follows: 

0 ilhat part will USDA play in DHEU's NCHPD activities and 
other health activities^ 

USDA will work cooperatively with DHEU and will supply 

the authoritative rural health care services policy inputs. 

o How' will these "policy inputs" be obtained? 

RDS's Economic Development Division {which is studying 
CHP areas and developing a data base about these areasy-* 
will be given the tools and responsibility to carry ouL 
rural health care services tertiary research activity-! 
regardless of funding source. RDS would be responsible 
for coordinating all federal rural health care services 
research and for inputting the authoritative rural health 
care services policy into DHEU's NCHPD and other health 
activities. 
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o What is the normative policy of the USDA as it addresses 
rural health care services goalsf 

Those goals are full equality of accessi high quality of ' 
care and the attainment of rural health standards on a 
par with urban health standards in specific rural areasi 
i«e.-» the most rural areas Ithe highest numbered rurality 
codes in Section 7i Final Report! . 

o yhat rural health care services delivery system model or - 
mcdelsi as well as criteria-i does the USDA consider or 
want to be considered as part of its normative policy to 
attain the above stated goalsf 

This model is shown in Figure 2-1 of the Final Report . 
Furthermore this nodel is the framework for the subject 
categorization format -CAppendix F> used in the assessment 
effort and part of step 2 of the "ideal" knowledge assess- 
ment methodology. 

At this point it would, be possible to complete step Mi the 
knowledge aggregation" by reorganizing the subject categorization 
format aipha-numerically along the delivery system model repre- 
sented by Figure 5 of the Final Report . An example of this process 
IS shown in Figure 2 for "general health", representing part of 
the aggregating template. 

Please note that IV-Evaluation-i X-Technology and XI-Hethodology 
are subject areas of the subject categorization format which support 
the knowledge assessment component of the "tertiary research" 
activity in the larger sense. That is they are used in steps li2-i 
3i and H of Figure 1. 

Using the appropriate "aggregating template" and the potential 
knowledge vacuum areas as a guide, the specific research and 
development documents are acquisitioned from the technical infor- 
mation system. For example, the user interested in the consumer 
aspect of rural health care would acquisition the documents which 
dealt with the subject categories lAl, IA2, IA3, VIIB, VIIBl, 
VIISM, IX A -and IXE. These documents and those for any other subject 
area can be easily identified by using Table 3. Appendix F, 
Subject Categorization Format of the Final Report is the narrative 
key to the alphanumeric code of the subject areas. The document 
number in Table 3, e.g. 005, is the entry into Appendix 6-1, 
Research Publications Accepted - By Title, Final Report yielding 
specific bibliographic data for the documents desired. These 
documents are then acquisitioned and analyzed for data elements 
using as the standard the knowledge required to implement the 
policy derived model rural health care delivery system. Section T 
of the Final Report is a suggested starting point for such a 
"knowledge aggregation." Steps 5 and b of Figure 1 are thus the 
results of this iterative process. Obviously this approach 
requires appropriate resources of funding, time and talent {both 
academician and decision makingJ. 



ERIC 



u 

0019 



m 

fH 01 

c 

m 3 o 

20^ V9 



w ^ *v 5^ ^ 




V9 













01 












M 




o 




4J 




6 




3 

a 








c 








•H in 












u 


3 




01 


m 


01 CL 




4J 


a 






X 




O 3 




Of •H 


B O 








▲ 

m 

o 


>- 








UJ 


yi 




4J 




01 




IQ 






O) 








01 








1» 




c 


<0 


CD 






U 


on 




«H 


m 


m 




01 




01 






Ol M 






XI 4J 




01 


c 


01 c 








ip4 01 




3 




3 E 






A fli 

o w 




c 


c 


C ^ 




1 




^ 01 

1 



fU 
01 

c 

3 
CP 



f-t oj ni 7 
— A — o 



ERLC 



Table M is a reordering of Table 3 so that a one-to-one 
correspondence can be made with Appendix 6-1 of the Final Report 
yielding indepth subject categorization for specific documents- 
Tables 3 and M represent indepth subject categorizations from 
Appendix F-i Final Report and constitute data not in that Final 
Report but gathered during the assessment effort^ It is hoped 
these tables will extend the usefulness of the Final Report * 

The above discussion should clarify s the recommendations of 
Section 12 of the Assessment of Rural Health Research Final 
Report -! in the broader concept of ••tertiary r^esearch** activity^ • 
the relationship of a comprehensive knowledge assessment with 
such a "tertiary research** activity and the requirements for such 
an activity n and the position of the assessment effort to date* 
in relation to this "tertiary research" concept-i i-e--i the Final 
Report represents the beginning step toward a comprehensive 
knowledge assessment as well as an important component in the 
"tertiary research" concept- It is this concept which is 
necessary to overcome the pervasive problems of rural health cara 
services delivery and to a larger degree rural development- 
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